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Abstract 

We give a self-contained, new proof of the monotonicity of the quan- 
tum relative entropy which seems to be natural from the point of view 
of quantum information theory. It is based on the quantum version 
of Stein's lemma which provides an operational interpretation of the 
quantum relative entropy. 



1 Introduction and Definitions 

The monotonicity of the quantum relative entropy is one of its deeper prop- 
erties. It has been proved by Lindblad in [7] for finite quantum systems 
and by Uhlmann in for the most general situation. Lindblad based his 
proof on the strong subadditivity of the von Neumann entropy which was 
shown by Lieb and Ruskai in |Hj . At the present time there are several proofs 
of these entropic properties. The most prominent proof is perhaps Simon's 
elegant derivation of the famous Lieb's concavity (cf. jlUji. which implies 
the joint convexity of the quantum relative entropy (cf. JSJ. This in turn 
suffices to show the monotonicity of the quantum relative entropy and the 
strong subadditivity of the von Neumann entropy (cf. 8 ). All these proofs 
are analytical in spirit. It is the intention of this article to provide another 
proof of the monotonicity in the finite dimensional situation which could 
be more appealing from the point of view of quantum information theory. 
The guiding idea in our approach is that (in complete analogy to classical 
information theory) the notion of relative entropy obtains its full informa- 
tion theoretical justification through an appropriate law of large numbers or 
ergodic theorem. Such ergodic theorem (cf. Theorem l2.1l in the next section) 
has been formulated and partially proved for the mean relative entropy of a 
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completely ergodic state with respect to a stationary product state by Hiai 
and Petz in [I]. Later on Ogawa and Nagaoka (cf. proved that result in 
the case of stationary product states. However, they used deep properties 
of the so called quasi-entropies, which are analogous to the monotonicity 
of the relative entropy. In the next section we will present an elementary 
proof of this ergodic theorem in the case of stationary product states. An 
ergodic version of that result (which was conjectured by Hiai and Petz) may 
be found in [2]. It was not possible to avoid the usage of monotonicity and 
joint convexity in the proof of that ergodic theorem in but these proper- 
ties were only needed to estimate entropies of /-ergodic components on local 
algebras, which is unnecessary for the stationary product case. We present 
a complete proof here in the product situation which does not make use of 
these properties. 

Once we have this theorem in the stationary product situation it is almost 
trivial to obtain the monotonicity. In fact, according to this result the rel- 
ative entropy equals a thermodynamic parameter which trivially decreases 
if the underlying algebra of observables is replaced by a subalgebra. In view 
of a well-known representation theorem for completely positive unital maps 
discovered by Kraus (cf . |Hj ) this implies monotonicity. The derivation of the 
monotonicity is the content of the third section of this article. 
In the appendix we explain the very nice approximation result of Hiai and 
Petz upon which our whole result rests. 

We close this section with the review of some basic definitions and no- 
tions. Let A := B(7i) be the algebra of operators acting on a finite dimen- 
sional Hilbert space 7i and let d = dmiTL. States on A are in one-to-one 
correspondence with density operators acting on the Hilbert space Tt. We 
consider the quasilocal algebra .4°° which is defined in the following way: To 
each site x € Z we assign a copy A x of the algebra A. Then for each finite 
set A C Z we define A\ := (S> x eA i- e - the algebra associated with A. For 
finite subsets A, A of Z fulfilling A C A there is a natural inclusion of A\ into 
Aj^ given by a i— > a ® 1a\a • ^ ne quasilocal algebra A 00 is given by the norm 
closure of the algebra (Jacz-#a<oo ^A- A state r on .4°° is a linear, positive 
and unital map of A°° into C. Each state r on A 00 defines a family of states 
{'?"^}acz,#a<oo on the local algebras A^ which fulfill \ A\ = for 
A C A. Since we will deal only with stationary states we confine ourselves to 
the sets of the form A(n) := {0, . . . , n — 1}, n G N. In what follows we will 
always abbreviate t^ 11 ^ by and Au n ) by A^. A detailed discussion 
of the quasilocal algebras may be found in the monograph 

For the convenience of the reader we recall the definition of the relative 
entropy of a state a on a finite dimensional C*-algebra C with respect to a 
state r: 




tr(_D CT (log D a - log D T )) if supp(cr) < supp(r) 



oo otherwise 
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where D a respectively D T denote the density operators of a respectively 
r and supp(er) is the support projection of the state a. The mean relative 
entropy of the stationary state uj\ on A°° with respect to the stationary 
product state L02 is given by 

s{u u u 2 ) := ton -5(J n) ,4 n) ) = sup-5(o;i ri) ,4 n) ), 

n-»oo n n n 

where the last equation holds by the superadditivity of the relative entropy. 



2 A Law of Large Numbers for the Quantum Rel- 
ative Entropy 

Our proof of the monotonicity of the relative entropy will be based on a law 
of large numbers for the quantum relative entropy. Let ipooi f<x be stationary 
product states and let e G (0, 1). We define 

/M^oc^oc) := min{log^ n )(g) : q G A {n) projection, ^ n \q) > 1 - e}. (1) 

The projection at which the minimum in Q is attained represents an 
ideal measurement that distinguishes the states ij)^ and in an optimal 
way. The relationship of the quantity defined in and the quantum relative 
entropy is the content of the following theorem. 

Theorem 2.1 Let ipoo^oo be stationary product states and let e G (0,1). 
Suppose that S(ip, ip) < 00 holds. Then we have 

lim -Pe,n{^oo,<Poo) = S(lp,(p), (2) 
n^oo n 

for all e G (0, 1). 

Remark Recall that the mean relative entropy of the stationary product 
state with respect to the stationary product state fulfills 

s(i>co,<Poa) = S(lp,if). 

Proof of Theorem 12. It We choose an r\ > 0. Then according to Theorem 
14.11 in the appendix there exists an integer I > 1 such that for the abelian 
algebra B[ considered in that theorem 

jS^\B h ip^\B l )>S(fl ) ,<p)-r i) (3) 
holds. We consider the quasilocal algebra Bf° and define 
P:=Voor^°° and Q := (p^ \Bf°. 
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Note that these states are i.i.d. states on Bf°. We will think of this abelian 
algebra as continuous functions on the maximal ideal space Bf° which in 
turn may be represented as the infinite cartesian product of a finite set 
B\. Let Dm denote the classical relative mean entropy of the probability 
measure P with respect to the probability measure Q. Then we have by 

D M = \B u <p® \Bi) < S^ (0 ,V (0 ) = lS(if>,<p) < oo, (4) 

since the projective measurements increase the von Neumann entropy (cf. 
[H]). We choose a 5 > and define 

C (n) ._ r G B n . n(D M -S) P (n) M n(D M +S) } , g x 

By the law of large numbers we have lim n _ >QO p( n )(CW) = 1. Consider the 
projection r\ n G corresponding to the characteristic function l C ( n ). 

Then we have 

V {ln) {n n ) = Q^ n \C {n) ) < p( n \c {n) )e- n{DM - 5) 

< e - n ( D M-S) 

< e -n(l(S(M-v)S) by Q ( 6 ) 

For each integer k > 1 we set k = nl+j,0<j<l, and define 

Qln ■= ri n and q k := q in ® l[i ntk -i]- 

If n is large enough we have by ® and the law of large numbers 

^)(q k ) = ipW(q ln ) = ^ ln \r ln ) = P(«)(C(")) > 1 - e. 

Hence the condition in the definition is fulfilled. On the other hand we 
obtain 

&,fc(V'oo,¥>oo) < log(/? (fc) (g fe ) 

< lo ge -"('( 5 ^^)-'')- 5 ) (by®) 

= -nl(S(ip,ip) -rj- -). 

This shows that 

limsup-/3 £i fe(V>oo,¥>oo) < -5(^1 <p), (7) 

n— >oo /s 

since k — > oo iff n — > oo, linijj^oo = 1 and 77, 5 > were chosen arbi- 
trarily. 
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In the next step we show the existence of the limit in and that this 
limit equals —S(ip,(p). Let (t y ) be a sequence of projections in AS y ' such 
that y — > oo and 

liminf -\og^ y) {t v ) < S(ip,ip). 

y— >oo y 

Then there exists an a > and a subsequence, which we denote by (t y ) 
again for notational simplicity, with the property 

tpM(ty) < e -y(s(M+*). (8) 

Let h = H(PW) denote the mean entropy of the i.i.d. measure P and 
consider the set 

F (n) := {uj n € B? : e - n{ - h+8) < P (n) K) < e^"^}, (9) 
then we have 

lim p( n )(F^) = 1 by the law of large numbers. (10) 

n—*oo 

Let q n be the projection in «4r n ) corresponding to some uj n S 
(cf. ©) then we have 

f {ln) (q n ) = Q (n) K) > e -"(^M+^+25) (by defmition of C (n) and F (n)) 
> e -n(«5( 1 /', V )+«(5(V)+'?)-Si+2<5) 5 (-q) 

where := X^=l ^(-^(Oft,;) logtr(gj^) and a; and g^j were defined in l|29j). 
The validity of the last inequality follows on the one hand from @. On the 
other hand we have 

h = 5(^ ) r^0 = -^ (Z nS^^ ) ^0-tr Bi (^ Wre! log J D v(;)re; ) 
< -l(S(iP, <p)-v)~ tr(D^ ro log D v(0 ) - (by © and 
= W)+r,)-J?,, 

which shows (|11|) . Note that each minimal projection s„ € Z3, can be 
written as &j = \(li jt i- We define the following set: 

jpi) .— ( Sn g gW : Sn minimal projection, — logtr(s n ) < £7 + 5}. (12) 

n 

Then the law of large numbers implies that 

lim ?W(£( B )) = 1, (13) 

n—>oo 

(n) 

after obvious identification of the minimal projections in B\ with elemen- 
tary outcomes of Bf. (Observe that by definition E\ is the expectation of 
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logtr(g(y) with respect to P.) Let pi n £ denote the projection corre- 
sponding to the characteristic function of the set n n L^ n \ Then 
for all sufficiently large n we have ip{pi n ) > 1 — e by (fTUl) . lfT5)l and (JSJ). 
Consider the embedding e/ n of the projections ^ fulfilling (jHJ into an ap- 
propriately chosen ,/4.(' n ). For example we choose the unique n € N with 
(n — 1)Z < y < nl. Then we have 

^ ln) (e ln )=^y\t y ) (14) 

and 

^ ln \em) = 4> {ln) (e lnPln ) + ^ ln \e ln (l- Pln )) 

< i> iln) (e lnPln )+E (by V(pj«) > 1 - e) 

= tp (ln) iPlneinPln) + ^ ((1 - Pln)einPln) + £ 

< Tp {ln \pineinPln)+2e 

= tr(pi n D^ (tn )pi n ei n ) + 2e. (15) 

In the next step we will estimate the first term in the last line above. Consider 
the spectral decomposition of Pi n D^,(in)Pin into one-dimensional projections 

bin 

PlnD^(i«)Pln = y] \,ln r i,lri' 
i=l 

where b\ n = tr(pj n ). For 5 > we define the set 

T 5M := {i G {1, . . . , &,„} : A Mn < e^^W^}, 

and 

Then we have 

lim V (/n) (pin ~ n,ln) = for a11 5 > °- ( 16 ) 

n— >oo 

In fact, observe that 

1 > £ A M „ > e - fa ^W- 5 )#r|, n = e-^W-Mpin - r SM ). 

o.ln 

Hence we have 

tr( Pln -r SM )<e ln ^~ 5 l 

Thus, if there would be a number c > and a 5o > such that 
limsup n _ >oc ?// /n ' l (l — r,5 0) £ n ) = c > there would be a contradiction to the 
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Proposition 2.1 in pQ, which implies that there is no sequence (q n ) of pro- 
jections in _4.( n ) with ^ n \q n ) > / > and limsupj^oQ i logtr(g n ) < 5(^0 • 
This shows our claim (jlBJI . 

The limit assertion (|16|) implies the following estimate for sufficiently 
large n G N: 

ti(pi n D^ ln)Pln ei n ) < e -HSW-S) tv(r iM ei n )+e 

bin 

< e- fa ( s W- 5 )^tr(r^ n e in )+e 
i=i 

= e-' fl ( s W~ 5 )tr( WnQn )+ £ . (17) 

Note that each projection pi n can be represented as a sum of minimal pro- 
jections Si >n G 23j : 

«G/(p in ) 

for some index set I^pin). Recall that by construction the operators si^ n are 
projections onto eigensubspaces of D (i n ). Let {Mi.n/jii be the eigen-values 

corresponding to the set of minimal projections {si, n }iLi- Then by lfTT|) we 

have 

tT(p ln e ln ) < e n(S(Ml+(SM+v)l-E l+ 26) £ ^ ( Sl , n )tr(s hn e ln ) 

*6/(p in ) 

_ e n(S(^, V )l+(SW+v)l-Ei+28) ^ e n( " logtr(s! '™ )} /ii ntr(sj n e Zn ) 

*eJ(pi„) 

< e n(S(iP, V )l+(S(iP)+v)l+3S)^ln)( pinein) (by ^ 

= e n(S(^)!+(SW+,)! + 3^M ( g (by®) 

< e n(5(V,v)i+(5 , (V)+r?)«+35) e -y(5^^)+a) ( by hg) 

Taking into account (|17|l and (|18jl we obtain 

Observe that lim^oo V- = 1 and a > hold. Hence if <5, 7/ > are chosen 
appropriately small we can achieve that the exponent in the last inequality 
becomes negative for large n. This fact combined with (|15|) and l)14|) shows 
that 

lim t/>(i v ) = 

holds. This limit assertion toghether with (J7J) shows ©. □ 
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3 Monotonicity of the Quantum Relative Entropy 



Let T : A — > A be a unital, completely positive linear map of a finite 
dimensional C*-algebra A into itself. There is a dual map T# with respect to 
the inner product defined by the unique trace tr (which extends canonically 
to the state space S(A)) given by 

tr(D v ,T(a)) = tr(T # (A/,)a) for all a G A and all ip G S(A). 

In [5j K. Kraus showed that for each unital, completely positive map T there 
exist a finite dimensional Hilbert Sp£lC6 !~~Cai Si Stclt6 a on B{TL a ) and a unitary 
operator U : TL <8> H a — > H <8> W a such that 

T # (^) = tin a {U(Djf, ® Da)U*), (19) 

where tr-^ a denotes the partial trace with respect to the Hilbert space 7^ a . 

Theorem 3.1 (Monotonicity of the relative entropy) Let ip,<p be 

states on A and let T : A — > A be a unital, completely positive map of A 
into itself. Then it holds 

S^^)>S{^oT,ipoT), (20) 

or equivalently 

S(D^D V ) > S(T # (D^),T # (D V )). (21) 

Proof of Theorem I3.lt The monotonicity holds trivially in the case 
S(ip, if) = oo. We consider the case S(ip, ip) < oo and define two states 
ip, (p on A ® BiTia) by their density operators: 

:= U(D^ <g> D a )U* and := U(D V <g> D a )U* , 

where the unitary operator U :Ti® 7i a — > Ti® Ti a and the density operator 
a) are chosen according to the representation ()19j) of the com- 
pletely positive, unital map T. Observe that according to the representation 
((TU|) we have 

D m = tT n a (U(D^ D a )U*) = T # (D^). (22) 

and 

D^ = T # (D V ). (23) 

Consider the quasilocal algebra (A ® B{7i a )) 00 and the stationary product 
states with = ip, (p^ with (p^ = (p on (A <g> B{Ha))°° ■ Note that 
the algebra A°° is a subalgebra of (A® B(Ti. a ,))° c ■ The definition Q implies 
that 
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and hence by Theorem 12.11 

-S$\A,<p\A) = lim -f3 e , n {^ 00 \A co ^ 00 \A co ) 

n— too n 

1 

> lim -P e ,n(^ 
n— >oo 7i 

= -S^ip). 

Using Q22j) and (|23|) this last inequality chain shows that 

S(T # (D^),T # (D V )) < S(^) 

= S(U(D i} ®D a )U*,U(D^®D c ,)U*) 
= S(D^,D V ), 

since the relative entropy is invariant under the action of the unitaries and 
simultaneous tensor multiplication with D a . □ 

4 Appendix: The Hiai-Petz- Approximation 

In this section we give a proof of the result established by Hiai and Petz 
in [I]. At the same time we simplify slightly their arguments. Let <p be a 
stationary product state on the quasilocal algebra A°°. Consider the spectral 
resolution of D (i) 



d 
i=l 

where Aj are the eigenvalues and ej are projectors onto a complete set of 
eigenvectors of D (i) . The density operator D („) can be written as 

d 

D v (n)= ^ ■...■A i „e il <g)...<g)e in , 

H,...,i n = l 

or after collecting all one dimensional projectors ® . . . (8> ej n which corre- 
spond to the same eigenvalue of (n) as 



V 1 

ni,...n d :ni+...+n [ j 



E fn^^Pn,...^, (24) 

..+n d =n \fc=l / 



with 

Pm,...n d '■= &h ® • • • ® e i n i 

where 

-fni,...n d := {(«!, • • • ,in) ■ #{j : ij = k} = n k for 1 < k < d}. 
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We define the map 



by 



E ■ A( n ) — >. r> A^n 

n\,...,n d : ni+...+n,j=re 



^n(a) : = P ni ,...,n d a p ni ,...,n d - (25) 

ni,...,?!^: ni+...+rid=n 



The next theorem is due to Hiai and Petz, Lemma 3.1 and Lemma 3.2 in 

EQ- 

Theorem 4.1 (Hiai and Petz) If ip is a stationary state on A°° and B n 
is the abelian subalgebra of generated by {p ni ,...n d D^{ n )p ni ,...n d }n 1 ,...,n d ^ 

{Pni,...n d }ni,...,n d then 

S(^ n \<p^) = S(^ t/W n) \B n ) + S(^ oE n )-S{^), (26) 
and 

S(V> (n) o E n ) - S(^) < dlog(n + 1), (27) 
and consequently we have 

lim -5(^ (n) t Bn, \ B n ) = s(if>, <p). (28) 

n— too n 

Proof of Theorem I4.lt We will prove the theorem only in the case where 
the density operator D (i) is invertible, this extends trivially to the general 
situation. Since the algebra B n is abelian it is representable as: 



B„ = ©C«, n . (29) 



i=l 



Using the definition of the algebra B n and the representation (|2*9*|) it can be 
easily seen that 

D ^\B n =^ tT { D - l pWq i< n)qi ) n, (30) 
1=1 

i.e. the density operator D^{ n )^ Bn € B n corresponding to if^^ \ B n with 
respect to the trace tr# n of B n is given by (|30|) . Similarily we have also 

D ^)\B n = ^2to( D tp (n)<li,n)qi,n- (31) 
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We have the following equation for the difference of the relative entropies: 

- S(D^ n )) - tr(£^,(„) logD v („)) + S{D^ Bn ) 

Since D („) is invertible log Djb)^ is well defined and contained in B n . All 
projections q^ n commute with log £) („). Thus we obtain 

tr B„(-D^) rBra logI^( ra ) rB J = tr(^ ( „) logD^n)) 

+ ^ tr (£V™)%,n)logtr ( 32 ) 

i=l 

where we have used (|HU|) and (|31|). And hence 

(33) 

On the other hand we can easily see that 

F(n f. tr(iy„ )g , n ) 

En(D^)-^ tv(qin) q hn , 

and therefore 

S^EniD^))) = S(D^ n)tB J +^tr(Z^ ( „)% in )logtr(g i)ri ). 

i=l 

Hence by (|33j) we have established the first equality of the theorem: 

S{4 n \v {n) ) = S{^ n) \B n ,v {n) \B n ) + S(^oE n )-S(^). 
In order to establish (|27|) we need the following entropy inequality: 

k k 

where Di are density operators, ctj are non negative real numbers summing 
up to 1 and H({ai}^ =l ) denotes the Shannon entropy of the probability dis- 
tribution {oj}k =1 . An elementary proof of this inequality can be found in [5]. 
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Consider a spectral resolution of the density operator D^(„) = zZi=i ^i,nPi,n 
into one-dimensional projections. Then we have 

d n 

S(E n (D fin) )) - S(D fin) ) < ^2m, n S(E n (p ijn )) +H({m, n }fl 1 ) 

i=l 

- S{D^ {n) ) 

d n 
i=l 

< dlog(n + l), 

since for each projector pi >n the operator Pm,...,n<i(pi,n)Pni,...,nd has at most 
one dimensional range and hence the density operator E n {pi )n ) can have at 
most (n + l) d dimensional range. Here we used an obvious estimate for the 
cardinality of partitions of the number n into d numbers. □ 
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